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PREFACE 


This  Interim  report  was  produced  as  a result  of  the  Phase  IIIC 
activities  ot  Contract  F41609-71-C-00G8,  entitled  "Research  on  Operational 
Combat-Ready  Proficiency  Measurement."  This  contract  was  performed  by 
Manned  Systems  Sciences,  Inc.,  Northridge,  California,  for  the  Flying 
Training  Division,  Air  Force  Human  Resources  Laboratory  (AFSC) , Williams 
AFB,  Arizona.  Major  J.  Fitzgerald,  Chief,  Combat-Crew  Training  Branch, 
was  the  contract  monitor. 


This  report  is  one  of  a series  of  seven  reports  constituting  the 
Final  Report  of  Contract  F416G9-71-C-0008.  These  reports  are  listed 
below: 


Combat-Ready  Crew  Performance  Measurement  System: 

AFHR1-TR-74- 108 ( I ) : Final  Report 

« 

AFHRL-TR-74-108(II)  : Phase  I.  Measurement  Requirements 

AFHRL-rR-74~lU8 ( 1 1 1 ) : Phase  II.  Measurement  System  Requirements 

AFHRL-TR- 74-108 ( I V) : Phase  IIIA.  Crew  Performance  Measurement 

AIHRL-IR- 74- 108 (V) : Phase  IIIB.  Aerial  Combat  Maneuvers  Measurement 

AFHRL-TR-74-108(VI):  Phase  IIIC.  Design  Studies 

AFHRL-TR-74-108(VII) : Phase  HID.  Specifications  and  , Implementation  Plan 
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I . INTRODUCTION 


Research  for  the  improvement  of  combat-crew  training,  and 
the  efficient  execution  of  current  training  programs,  are  heavily 
dependent  upon  good  sources  of  information  about  trainee  perform- 
ance during  and  at  the  end  of  training.  In  an  effort  to  improve 
training  performance  information,  this  study  is  directed  to 
(1)  systematic  definition  of  performance,  and  (2)  development  of 
methods  for  measurement. 

This  program  is  divided  into  four  phases,  however,  the  third 
phase  has  been  further  divided  into  four  parts  as  the  result  of 
expansion  of  the  scope  of  the  program.  The  structure  of  the 
program  may  be  most  easily  comprehended  if  the  following  planned 
sequence  is  borne  in  mind:  (1)  establishment  of  measurement 

requirements,  (2)  establishment  of  measurement  system  require- 
ments, (3)  conduct  of  design  studies,  (4)  development  of 
specifications  and  an  implementation  plan,  and  (5)  preparation  of 
the  Final  Report. 

As  shown  in  Figure  1,  seven  reports  will  be  prepared  under 
this  contract;  the  first  three  reports  present  measurement 
requirements  (Phase  I:  Pilot  Measurement  Requirements;  Phase 

IIIA:  Combat-Crew  Measurement  Requirements;  Phase  IIIB:  Air 

Combat  Measurement  Requirements),  i.e.,  the  measurement  to 
provide  information  needed  for  combat-crew  training  research. 
These  requirements  have  been  determined  through  surveys  conducted 
at  combat-crew  training  sites  (Luke  AFB,  Davis-Monthan  AFB, 
Tyndall  AFB,  Castle  AFB,  Altus  AFB,  Dyess  AFB,  George  AFB,  Norton 
AFB,  and  Nellis  AFB) . The  fourth  report  prepared  treated 
measurement  system  requirements  (Phase  II:  Measurement  System 

Requirements),  including  research  procedures,  measurement 
processing,  system  criteria,  and  preliminary  system  analyses. 

The  current  Phase  IIIC  report  deals  with  design  studies  to 
determine  desirable  system  features  to  meet  the  research  'needs 
documented  in  the  earlier  reports  of  this  sequence.  Chapter  II 
presents  analyses  of  factors  to  be  considered  in  training 
measurement  system  design.  Chapter  III  indicates  the  nature  of 
tradeoffs  for  each  system  criterion  established  in  the  Phase  II 
report.  Recommendations  based  on  these  analyses  are  discussed 
in  Chapter  IV. 
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II.  SUPPORTING  ANALYSES 


A number  of  analyses  have  been  performed  in  this  program  to 
guide  design  decisions.  Eight  primary  analytic  steps  are 
presented  in  this  chapter;  these  steps  are  listed  in  Table  1, 
along  with  comments  indicating  the  specific  sources  of 
information  used  in  each  analysis  and  the  principal  products. 

4 

Example  measurement  (1)*  was  produced  as  a product  of  visits 
to  combat-crew  training  units  to  attempt  to  express 'the  main 
items  of  information  relevant  to  training.  Using  this  as  a 
stimulus,  preliminary  measurement  definitions  were  made  along 
with  assumed  techniques  for  computation,  leading  to  identification 
of  a required  set  of  parameters  (2)  for  measurement  generation. 
These  analyses  were  begun  in  earlier  program  phases,  and  subse- 
quently were  revised  and  extended. 

Continuing  from  the  basic  analyses,  specific  computational 
algorithms  were  chosen  for  both  automatic  (3)  and  manual  (4) 
modes  of  measurement,  forming  an  initial  software  specification. 
The  next  steps  in  the  sequence  attempt  to  determine  best  methods 
for  sensing  the  needed  information  (5),  and  the  nature  of 
appropriate  data  processing  equipment  (6) . As  video  or  photo- 
graphic means  of  sensing  information  must  be  considered,  it 
follows  that  a minimum  resolution  for  such  devices  must  be 
specified  to  ensure  that  the  desired  data  are  sufficiently 
legible  (7) . Lastly,  data  are  collected  relating  to  cost  and 
personnel  requirements  (8)  to  permit  tradeoff  analyses  between 
alternative  measurement  system  candidates. 

Prototype  Measurement 

The  genesis  of  measurement  development  in  this  program  is 
the  definition  of  training  information  requirements  obtained 
through  visits  to  combat-crew  training  units.  The.  principal 
representation  of  these  information  requirements  has  been  termed 
prototype  measurement;  an  example  is  presented  in  Table  2.  The 
information  needs  have  been  prepared  for  each  flight  phase  in  a 
tabular  form,  with  blanks  indicating  specific  measurement  which 
should  be  developed.  In  a number  of  cases  the  measurement  to 
fill  the  blank  is  obvious;  in  other  cases  much  thought  must  be 
given  to  the  proper  measurement  and  to  the  feasibility  of 
indicated  measurement. 

Measurement  Parameters 

When  measures  are  defined  to  answer  to  informational  needs, 
the  parameters  which  must  be  sensed  to  permit  measurement  are  not 
immediately  evident,  since  the  measure  specifies  the  output  of  a 

*Parenthetical  numbers  relate  to  the  numbered  analyses  in  Table  1. 
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TABLE  1 


DESIGN  ANALYSES 


PURPOSE 

1.  Determine 

Measurement  Needs 


SOURCE 


CCTS  Visits 


Identify  Physical  Prototype  Meas. 
Parameters  for  and  Preliminary 
Measurement  Measure  Algorithms 

Develop  Automated  #1  & #2;  Assume 
Measure  Descrip-  Instrumented 
tions  Aircraft 


Develop  Manual 
Measure  Descrip- 
tions 


Determine  where 
to  Obtain 
Information 

Determine  Data 
Processing  Needs 

Determine  if 
Visual  Informa- 
tion is  Suf- 
ficiently 
Accurate 


#1  & #2;  Assume 
Video  Cameras 
Installed  in 
Aircraft 

Analysis  of  Para- 
meter x Data  Source 
x Training  Phase 

#3  & #4 


Avail.  Literature 
Field  Studies 


RESULT 


Prototype 

Measurement 

Measurement 

Parameters 


Measure  Functions  & 
Conditions  (Implies 
Software) 

Measure  Functions  & 
Conditions  (Implies 
Procedures ) 


Alternative  Feasible 
Sources  of 
Information 

Alternative  Data 
Processing  Equipment 

Video/Photo 

Specifications 


Determine  Cost 
Tradeoff  Data 


Industrial  Visits 


Cost  and  Personnel 
Estimates 
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TABLE  2 


EXAMPLE  OF  PROTOTYPE  MEASUREMENT 


TAKEOFF  G CLIMB* 


CONDITIONS ; 

Gross  Wt: 
Temp. : 


v\7 1 ng : 

Ait.  Set. : 


Runway : 
Field  Elev. 


Form  Pos , 


TAKEOFF  ROLL:  (TO  power  until  rotation) 

Power  Set:  Centerline  Dev.:  Min,  Max,  Av . 

Reject  Speed:  Computed  Heading:  Min , Max , Av . 

Time:  Dist:  Bank:  R Max,  L Max 

ROTATION : (Nose  gear  off  until  pitch  att.  established) 


Rot.  Speed:  

Pitch:  Rate:  

Final:  

Overshoot:  

LIFTOFF:  (Pos.  Vert.  Vel.) 


Stab.  Trim:  

Bank:  

Centerline  Dev. 
Heading: 


Unstick  Speed:  Pitch: 

Vert.  Vel.  After:  Sec.: 


Bank: 


GEAR- UP : (Handle  up  until  gear-up  G locked) 

Gear-Up  Speed:  V.V.  Init. : V.V.  Final:  

Pitch:  Bank:  Hdg:  

FLAPS  UP:  (Start  up  to  full  up)  Note:  F106  has  no  flaps 


Trim:  

Pitch : 

A/S  (INIT) 
VV  (INIT) 
ALT  (INIT) 


Bank:  Hdg: 

(FINAL) 
(FINAL) 
(FINAL) 


1-52  Only 

IAS 

PITCH 

ALT 

VV 

TRIM 

Start 

X 

X 

X 

X 

X 

1st  Pos 

X 

X 

X 

X 

X 

2nd  Pos 

X 

X 

X 

X 

X 

Full 

X 

X 

X 

X 

X 

CLIMB  G LEVEL- OFF:  (Depends  on  Flight  Plan) 


INIT  FINAL 

PWR  A/S  MACH  HDG  ALT  ALT  PITCH  TRIM 


Accelerate 
Climb  A/S 
Climb  MACH 
Level-Off 


♦Also,  mandatory  communication  G instances  where  A/C  limits  are 
exceeded. 


X 

X 

X 

X 

X 

X 

X 

X 

(#1) 

(#2) 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

(Alt- 10*  VV) 

(to  Cruise) 

X 

X 

X 

X 

X 

X 

X 

X 

computation,  and  the  computation  itself  must  be  known  before  the 
inputs  to  the  computation  (the  parameters)  can  be  determined. 

Figure  2 depicts  the  relationship  between  the  specified 
measures,  the  computation,  and  measurement  parameters.  In 
Figure  2,  the  output  measures  (0)  correspond  to  the  information 
requirements  dictated  by  the  blanks  in  the  prototype  measurement 
forms.  In  addition  to  basic  test  parameters  (M) , the  following 
types  of  parameters  may  be  needed  for  computations  (1)  para- 
meters for  implementing  logic  to  start  and  stop  measurement 
computations  (S) , (2)  information  related  to  desired  perform- 
ance (D) , (3)  and  error  information  derived  from  the  difference 

between  actual  and  desired  performance  (E) . In  short,  given 
output  measures  (0) , to  determine  other  parameters  which  must  be 
sensed  (M,S,D,E),  it  is  necessary  to  determine  logic  and 
computations  to  be  used  in  measurement  data  processing  (i.e.,  the 
measurement  algorithms) . 

Automated  Measurement  Descriptions 

\ 

Assuming  automated  measurement,  i.e.,  parameters  are 
automatically  recorded  for  subsequent  computer  analysis,  the 
primary  details  of  measurement  computation  (Figure  3 shows  a 
representative  flow  diagram)  are  presented  in  Table  3 for  each 
maneuver  and  maneuver  segment  of  combat-crew  training  phases. 

The  table  indicates  the  name  of  each  measure,  the  specific 
function  to  be  computed,  and  the  s tart/s top  conditions  for 
controlling  computation.  For  example,  centerline  deviation 
during  the  takeoff  roll  is  desired  output  information,  the 
average,  minimum  and  maximum  deviation  are  the  specific 
computations  which  should  be  performed  between  brake  release  and 
rotation.  Comments  are  also  provided  as  considered  appropriate 
by  the  analyst  to  point  up  alternatives,  or  where  problems  may 
be  encountered  during  design. 

Since  this  table  indicates  the  functions  to  be  computed,  the 
conditions  under  which  computation  should  occur,  and  indirectly 
the  source  information  upon  which  to  base  computation,  the  basic 
information  is  provided  to  allow  preparation  of  computer  programs 
for  automatic  measurement. 

Manual  Measurement  Descriptions 

Automated  measurement  analysis  assumes  automatic  recording 
of  relevant  parameters  to  permit  automatic  computation;  that  is, 
each  parameter  must  be  recorded  at  a sufficiently  high  sampling 
rate  to  allow  computation  on  an  instant-by-instant  basis.  In  the 
case  of  computing  average  centerline  deviation,  recording  would 
occur  probably  from  the  release  of  brakes,  all  centerline 
deviations  would  be  summed,  when  a change  in  pitch  angle  was 
noted  the  summation  would  cease  and  the  total  divided  by  the 
number  of  samples  summated. 


TABLE  3.  AUTOMATED  MEASURE  DESCRIPTIONS 
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If  manual  data  reduction  were  to  proceed  in  the  same  fashion 
as  automated  measurement,  then  Table  3 would  also  provide  the 
appropriate  measurement  descriptions;  however,  manual  entry  of  a 
number  of  parameters  at  a high  rate  is  very  slow,  prone  to  error, 
and  exceedingly  tedious.  Nevertheless,  the  human  operator  must 
perform  essentially  the  same  functions  as  the  automated  system, 
as  shown  in  Figure  3,  to  produce  the  required  measures.  The 
human  operator  may,  however,  perform  measurement  computations 
himself,  and  directly  enter  the  measure  into  a data  base  for 
further  processing.  Since  measurement  calculations  such  as  the 
mean  and  standard  deviation  require  high-rate  sampling  by  the 
human  operator  in  order  to  achieve  the  computation,  these  are 
discarded,  and  only  functions  such  as  a specific  value,  the 
minimum  value,  or  the  maximum  value,  are  retained  as  allowable 
human  operator  functions . 

Manual  measurement,  then,  requires  that  the  human  operator 
search  for  starting  conditions  (a  specific  time  or  value,  or 

of— tolerance  condition)  and  then  enter  a specific  parameter 
value  or  search  for  the  maximum  or  minimum  value.  It  is  believed 
that  the  human  operator  can  reasonably  perform  these  tasks,  while 
performing  the  equivalent  of  the  automated  measurement  is  unlikely 
to  provide  an  attractive  alternative.  It  should  be  noted  that 
the  manual  measurement  processing  philosophy  to  be  used  does  not 
provide  all  the  information  obtainable  with  an  automatic  system; 
subsequent  tradeoff  analyses  must  take  this  into  account. 

Manual  measurement  descriptions,  within  the  restrictions 
noted,  are  presented  in  Table  4.  In  the  same  manner  that 
^utoro^ted  measurement  descriptions  are  believed  to  be  appropriate 
for  the  initiation  of  software  development,  the  manual  measurement 
descriptions  should  provide  information  needed  to  develop  manual 
techniques  and  operator  instructions. 

The  number  and  type  of  manual  operations  required  for  each 
training  phase  have  been  noted,  and  assuming  approximately  30- 
minutes  of  film  or  video  recording,  it  is  estimated  that  any 
flight  in  any  of  the  training  phases  analyzed  should  produce  data 
which  can  be  manually  analyzed  within  approximately  lh  hours. 

This  estimate  is  based  on  estimates  of  a number  of  manual 
operations  which  cannot  be  accurately  timed  without  direct 
empirical  test;  more  accurate  estimates  will  be  possible  only 
when  manual  data  processing  tests  are  conducted. 

Alternative  Data  Sources 

Tradeoff  analyses  are  to  be  especially  concerned  with  the 
information  provided  by  a given  system  compared  to  the  total 
information  needs.  Additionally,  design  information  is  needed  to 
point  the  way  to  a composite  system  (or  systems)  capable  of 
answering  to  all  information  requirements.  To  meet" these  needs, 
an  analysis  has  been  performed  indicating  the  alternative  sources 
from  which  measurement  parameters  can  be  obtained  (see  Tables 
5—13) . For  each  parameter  indicated  by  the  measurement 
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TABLE  5.  ALTERNATIVE  DATA  SOURCES  FOR  TRANSITION  PARAMETERS 


DATA  SOURCE 


GMT 

Pitch 

Pitch  Rate 

Roll 

Heading 

Airspeed 

MACH 

Altitude 

V/V 

AOA 

G 

Power 

Thrust  Rev 
Speed  Brakes 
Position,  xy 

C Deviation,  (Also  Rnwy  Lat.) 

Lat.  Drift 

Threshold 

DDR 

Spacing 

Main  Gear  Cntct 
Nose  Gear  Cntct 
Nose  Steer  Engaged 
Gear  Select 


X 

X 

X 

X 

X 

X 

X 

Q? 
X 
Q? 
Q? 
X RA 


X RA 
X - 


X RA 
X RA 


X RA 


Flap  Select 
Stab  Trim 
Drag  Chute 


UHF  Comm 


Initial,  Rnwy 
Break,  Wind 
Downwind,  Alti- 
meter 


GWT 

Wind  D/V 
Temp 

Field  Elev 
Alt  Setting 
Form.  Posn 
Rnwy  Assign 
Wheel  Brakes 


Parameters 


X « Available;  Q = Questionable;  RA  = Reduced  Accuracy; 
M = Data  from  Other  Sources  for  Error  Comparison. 

r n 


TABLE  6.  ALTERNATIVE  DATA  SOURCES  FOR  INSTRUMENT  PARAMETERS 
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TABLE  7.  ALTERNATIVE  DATA  SOURCES  FOR  INTERCEPT  PARAMETERS 


DATA  SOURCE 
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• 
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• 
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X) 
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Q) 

3 

Q) 

■P  u • 

PM 

O 

4-IOO 

'O 

0 

• 

-P  <0  P -P 

• G 

u 

0) 

PARAMETERS 

FUNCTION 

S 

rH 

ox!  P CM  W 

•H  O'  O 

U nJ 
-P 

PM 

0)  Q) 
tn  u 

c/) 

><  <d  & 

TJ  tp  u • * 
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PI 

G 0 

G 

1 3 1 

3 rl  0 -H  CM  rH 

G 

O 

nJ  o 

H 

X Q > 

< CM  PI  <C  O 1 

H 

A 

Pi  cn 

TARGET 

Heading 

xt 

Jr 

M 

Altitude 

$T 

XT 

M 

MACH 

XT 

*T 

M 

Azimuth 

X 

Elevation 

Prior 

X 

Range 

to 

X 

Range  Rate 

Lockon 

X 

Aspect  Angle 

XT 

X v 

D 

NCA 

*T 

ECM 

RA 

M 

Maneuvering 

RA 

D 

M 

INTERCEPTOR 

Pitch 

X 

X 

C 

Roll 

X 

X 

C 

Heading 

X 

X 

C 

Altitude 

X 

X 

c 

V/V 

X 

X 

C 

MACH 
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X 

C 

AOA 

X 

X 

G 

X 

X 

Power 

X 

X 

c 

Fuel  Quantity 
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X 

X 

Antenna 

Azimuth 

X 

X 

D RA 

Elevation 

X 

X 

D RA 

After  , (Tgt) 
Lock  1 (Tgt) 

Range 

X 

X 

D RA 

Range  Rate 

X 

X 

D RA 

Range  Gate 

X 

X 

Steering  Dot 

Error 

X 

X 

RA 

Firing  Circle 

Radius 

X 

X 

R R 

min . , max . 

X 

X 

Lockon  Pulse 

X 

X 

IF  Gain 

X 

RA 

Video  Gain 

X 

RA 

Erase  Intensity 

X 

RA 

• 

GMT 

X 

X 

X 

1 
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TABLE  7 


TABLE  8.  ALTERNATIVE  DATA  SOURCES  FOR  AIR  REFUELING  PARAMETERS 


DATA  SOURCE 


GMT 

Airspeed 

Altitude 

V/V 

Range  (To  Tanker) 

Range  Rate 
Stick  (Pitch) 

Stick  (Roll) 

Thrust 

Spoilers  (Speed  Brakes) 
Stab  Trim 
Probe  Engagement 
Centerline  Displacement 
♦Lights  Up 

Down 

Fore 

Aft 

Altitude  Error 
Crew  Coordination 


♦Lights  could  be  attained  by 
instrumenting  tanker , unlikel; 
due  to  logistics  problems. 


Probable  from  onboard  radar,  if  available 


LCL  Proced 


TABLE  9. 


ALTERNATIVE  DATA  SOURCES  FOR  AIRDROP  PARAMETERS 


TABLE  10.  ALTERNATIVE  DATA  SOURCES  FOR  FORMATION  PARAMETER! 

DATA  SOURCE 


LEAD  AIRCRAFT 
Airspeed 
Thrust 
Thrust  Rate 
Turn  Rate 
G's 

ELEMENTS 
Airspeed 
Heading 
Stick  Pitch 
Stick  Roll 
Stab  Trim 
Range 

Range  Rate 
Bearing 
A Altitude1 
GMT 

Star t/S top 

Crew/Formation  Coordination 


,Q 

T5 

• 

3 

0) 

■P  o • 

CM 

o 

M-l  0 O 

TJ  o 

•P 

fO  U -P 

• 

c p 

U) 

0 

A 

MM) 

P 

rtf  CM 

Q)  <u 

•H 

U 

-P 

tn  P 

•h  ty 

P • * 

W 

PI 

r o 

3 

•— 1 o 

•H  Qj  ^ 

c 

U 

(d  o 

< 

Cn  ^ 

< O 1 

M 

A 

& c/) 

X=  Instrumented  or  camera  on  lead  a/c. 

* L 

*A  Altitude  can  be  obtained  with  less  than  required  accuracy  by 
ins tr lamenting  altimeters  in  both  a/c.  However  this  possibility 
was  rejected.  64 


I y _ _ - 
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TABLE  1 1 


ALTERNATIVE  DATA  SOURCES  FOR  GROUND  ATTACK  PARAMETERS 


GWT 

Temp 

Press  (Alt.  Setting) 

Wind  (Direct/Velocity) 

Formation  Posn 

Pitch 

Roll 

Heading 

Airspeed 

Altitude 

V/V 

AOA 

G 

Slip 

Power 

GMT 

Target  Slant  Range 
Aim  Point  Er 
(HUD)  Bomb  Fall  Line 
Flight  Path  Er 
Impact  Pt 
Number  of  Hits 
Foul 

Dry  Pass 

Spacing 

Pickle 

Weapon  Release 
Crew  Coordination 


X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X 

X RA 
X 

(X) 
X RA 


X 

X 

X 

X 

RA  RA 


TABLE  12.  ALTERNATIVE  DATA  SOURCES  FOR  DART  FIRING  PARAMETERS 


PARAMETERS 


GMT 

Airspeed 

Range 

Azimuth 

Elevation 

Pass  Number 

Hits 

Crew  Coordination 


DATA  SOURCE 


i 3 l 


H X Q > rtj 
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03  U 4J 

• 

G 

CO 

U CU  <u 

M 

03  cu 

<u  <u 

0 

4J 

tr>  m 

*H  tji 

u • * 

CO 

G 0 

r1  9 

•H  ftr- 

c 

U 

03  U 

pt-f  M 

< O 1 

H 

0} 

X RA 
X RA 
X X 
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TABLE  13 


ALTERNATIVE  DATA  SOURCES  FOR 
AIR  COMBAT  MANEUVERING  PARAMETERS 


DATA  SOURCE 


PARAMETERS 


GMT 

Pitch 

Roll 

Heading 

Airspeed 

MACH 

Altitude 

V/V 

AOA 

G's 

Rudder 
Stick  Pitch 
Stick  Roll 
Thrust 
Flaps 

Speed  Brakes 
Target  Range2 

Range  Rate 
Aspect  Angle 
Heading  Crossing  An 
Elevation  (A  H) 
Armament  Switch  Posns. 

Fire  Pulse 

Fuel  Quantity 

Ordnance  Load 

Event  Timing  £ Marking 

GWT 

Crew  Coordintation 


Target  ranging  possible  only  during  terminal  tracking  or  when 
target  in  camera  range. 

Accurate  position,  X,  Y £ Z of  each  aircraft,  together  with 
instrumentation  of  each  aircraft  can  provide  these  data. 
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descriptions  (Tables  3 and  4) , data  sources  have  been  identified 
in  the  following  categories:  (Instr)  Obtainable  with  automatic 

instrumentation  recording,  (X-Y)  spatial  coordinates  obtainable 
from  such  devices  as  ground  radar  stations,  theodolite,  and 
ground  observers,  (Dual  V-P)  obtainable  with  either  two  photo- 
graphic cameras  or  a video  camera  recording  system,  (Audio) 
obtainable  with  audio  magnetic  tape  recording,  and  other  data 
available  from  verbal  reports,  flight  forms  and  operational 
documents . 

The  analyses  of  alternative  data  sources  was  performed 
separately  for  each  major  training  phase.  Since  performance 
information  needs  apparently  vary  as  a function  of  training 
phase,  different  systems  may  be  appropriate  for  different 
training  phases.  The  analysis  is  performed  in  this  way  to 
attempt  to  define  system  modules  that  can  collectively  meet  all 
information  needs. 

Note  that  while  alternative  sources  may  permit  data  for  a 
given  parameter,  not  always  the  same  accuracy  is  possible.  In 
Tables  5-13  X indicates  that  high  accuracy  is  available,  RA 
indicates  that  reduced  accuracy  is  possible,  but  sufficient  for 
the  purposes  envisioned,  and  Q indicates  that  data  are  available, 
but  it  is  questionable  whether  the  accuracy  is  sufficient  except 
for  unusual  situations. 

Data  Processing  Facilities 

It  is,  of  course,  desirable  to  have  all  data  processing 
tools  ready  at  hand  for  use  whenever  needed,  although  it  is 
possible  to  operate  under  some  circumstances  with  some  or  all 
computing  facilities  remotely  located.  In  addition  to  general- 
purpose  computing  equipment,  if  data  are  to  be  processed  from 
complex  airborne  instrumentation,  special  conversion  equipment 
is  needed. 

Dedicated  data  processor.  The  heart  of  the  measurement 
data  processing  facility  is  a general  purpose  digital  computer. 
Based  on  experience  with  extensive  inflight  and  simulator 
experiments,  the  computer  should  have  approximately  16,000  to 
32,000  words  of  memory,  a word  size  of  at  least  16  bits,  and  a 
basic  operation  time  of  approximately  1 microsecond  to  3 micro- 
seconds. However,  as  may  be  seen  from  Figure  4,  the  utility  of 
the  system  for  measurement  and  data  analysis  depends  on  the 
peripheral  equipment. 

(1)  A card  reader  permits  convenient  entry  of  data  collected 
from  external  sources  such  as  subjective  data,  paper-and-pencil 
measurement  forms,  and  data  from  other  experiments.  Computer 
programs  are  also  conveniently  manipulated  in  punched-card  form. 
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Figure  4.  Dedicated  Measurement  Processing  Facilities. 


(2)  Magnetic  tape  units  also  provide  a means  for  entry  of 
externally-collected  data  (possibly  from  airborne  instrumentation 
recordings),  and  are  also  useful  for  entry  of  occasionally- 
referenced  stored  data,  or  the  intermediate  output  of  long 
calculations. 

(3)  Although  it  is  possible  to  operate  without  disc  storage 
units  for  many  small  experimental  efforts,  use  of  disc  storage 
can  speed  operations,  increase  capacity,  and  provide  for  efficient 
data  storage  and  retrieval. 

(4)  The  line  printer  permits  high-volume  output  in  a timely 
fashion,  necessary  for  data  listings  and  multiple  statistical 
analyses . 

(5)  A Teletype  (or  typewriter)  permits  operator  interface 
for  program  control,  system  monitoring,  and  manual  data  entry. 

If  information  must  be  rapidly  presented  for  training  feedback, 
manual  data  entry,  software  or  data  editing,  then  the  use  of  an 
electronic  display  (cathode  ray  tube)  is  recommended. 

(6)  A paper-tape  reader  and  punch  provides  a low-cost  input/ 
output  capability,  and  compatibility  with  other  computers;  this 
is  a standard  feature  with  many  computers  and  Teletypes. 

(7)  Data  viewing  equipment,  such  as  video  monitors  and 
photographic  viewers,  is  needed  for  manual  data  reduction. 

Airborne  magnetic  tape  conversion  equipment.  If  both  the 
data  format  and  physical  size  of  airborne  magnetic  recordings  are 
the  same  as  the  magnetic  tapes  normally  produced  by  the  general 
purpose  digital  computer,  then  only  the  normal  computer  magnetic 
tape  units  are  needed  to  process  such  data. 


However,  the  physical  size  may  be  different,  requiring  that 
the  tape  be  rewound  onto  another  tape  reel;  if  a tape  cassette 
is  used  (such  that  the  tape  cannot  be  physically  removed)  then 
the  tape  must  be  electronically  copied  (requiring  a playback 
unit)  . 


In  an  attempt  to  maintain  data  accuracy  in  spite  of  noisy 
transmission  channels  and  recorder  irregularities,  current 
technology  dictates  a recording  format  which  is  different  than 
that  used  in  a general  purpose  digital  computer.  The  magnetic 
tapes  produced  by  current  airborne  instrumentation  systems  will 
normally  require  special  equipment  (probably  costing  in  excess  of 
$100,000)  to  enter  the  data  into  a digital  computer. 


It  is  clear  that  a savings  can  be  made  if  tapes  are  produced 
in  a form  requiring  little  or  no  Special  conversion  equipment. 
Current  airborne  instrumentation  formats  are  based  on  flight  test 
requirements  for  telemetry  of  data  to  ground  stations  while  the 
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aircraft  is  in  flight.  It  is  possible,  if  there  is  no  require- 
ment for  telemetry  and  if  performance  measurement  data  accuracy 
requirements  are  not  as  severe  as  those  of  flight  test,  that 
direct  recording  in  computer  compatible  format  will  permit 
sufficient  data  accuracy.  .However,  if  high  data  accuracy 
techniques  are  necessary,  or  if  compatibility  with  current 
airborne  instrumentation  recording  is  desired  ' (to  permit  data 
collection  with  currently  instrumented  aircraft) , the  special 
conversion  equipment  is  required.  It  should  be  noted  that 
conversion  equipment  may  be  required  for  several  types  of 
recording,  and  that  equipment  capable  of  converting  several  types 
of  data  tapes  may  be  desirable  (such  as  pulse  code  modulation 
(PCM) , pulse  duration  modulation  (PDM) , or  frequency  modulation 
(FM)  as  indicated  in  Figure  4. 

Time-share  computer.  Current  time-share  computer  facilities 
combine  large-computer  power  and  impressive  software  packages  for 
a very  small  investment  and  small  use  charges.  For  example,  a 
teletype  terminal  can  be  leased  for  approximately  $75.00  per 
month  and  computer  charges  will  average  about-  $15.00  per  hour 
(depending  on  the  amount  of  storage  and  computer  time  actually 
used).  The  Teletype  is  limited  in  input/output  speed,  limiting 
input  to  manual  entry  and  output  to  samples  of  file  data  or 
statistical  analyses.  Even  with  faster  terminals  now  on  the 
market,  such  an  installation  is  best  for  programming,  debugging, 
spot  checks  of  data,  and  trial  analyses. 

A further  complication  is  that  connection  with  the  time- 
share  computer  complex  is  through  standard  telephone  lines. 
Adequate  connections  may  not  be  possible  through  some  USAF 
switchboards,  requiring,  perhaps,  a special  telephone  installa- 
tion. Tollfree  calls  to  the  computer  complex  are  possible  from 
most  places  in  the  country;  however,  if  a toll  charge  should  be 
necessary,  the  hourly  cost  will  increase  greatly. 

Within  the  above  restrictions,  the  time-share  computer  may 
provide  an  excellent  inexpensive  approach  for  manual  data 
processing.  As  shown  in  Figure  5,  a data  viewer  (video  or  film) 
and  a Teletype  provide  a workstation  for  a data  clerk  to  sample 
the  desired  information;  the  computer  can  be  programmed  to 
assist  and  check  the  data  clerk.  Through  this  process,  edited 
data  files  can  be  accumulated  at  the  time-share  computer  complex. 
The  research  scientist  can  program  for  measurement  computations 
and  analyses,  using  data  collected  as  a basis  for  trial  analyses. 
All  the  previous  operations  can  be  performed  using  the  Teletype; 
however,  more  extensive  analyses  will  probably  be  more  efficiently 
conducted  remotely  at  the  time-share  computer  complex.  Since 
both  programs  and  data  exist  in  files  at  the  time-share  computer 
complex,  personnel  at  the  large  computer  can  perform  large-scale 
calculations  for  the  research  team.  Since  the  output  will  be 
extensive,  high-speed  printers  at  the  computer  complex  will  more 
efficiently  do  the  job,  to  be  transported  to  the  research  crew  by 
courier  or  mail.  Where  such  an  operation  is  feasible,  the  end 
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Measurement  Processing  with  a Time-Share  Computer  Facility 


product  will  be  nearly  equivalent  to  that  obtainable  with  a 
dedicated  computer. 

, Remote  computer . If  access  can  be  obtained  to  a properly 
equipped  nearby  computer  as  often  as  needed,  then,  of  course,  the 
result  is  equivalent  to  that  of  a dedicated  computer.  However, 
extensive  travel  is  required  to  reach  a remote  computer,  and 
1 access  is  limited,  then  the  result  may  be  lost  data,  slow 
response,  and  partial  inadequate  analysis. 

Figure  6 depicts  the  use  of  a remote  computer  with  manual 
data  processing;  conceivably,  the  operation  can  be  conducted  with 
automatic  data  collection,  however,  then  no  knowledge  of  data 
errors  will  be  available  until  a computer  listing  is  available, 
perhaps  days  later  when  little  can  be  done  to  recover  from  the 
damage  done  to  the  experimental  schedule. 

In  the  extreme,  the  use  of  a remote  computer  introduces  a 
two-step  sequential  process:  (1)  collect  data,  (2)  analyze  data. 

A completely  open- loop  approach  to  research  does  not  permit  any 
recovery  from  data  errors  or  experimental  design  errors;  it 
doesn't  permit  interactive  iterative  measurement  and  analysis 
development.  This  is  not  likely  to  be  a successful  approach 
unless  only  simple  limited  problems  are  encountered. 

A closed- loop  approach  to  research,  which  permits  changes 
and  improvements  in  technique  as  data  are  collected,  requires 
guaranteed  access  to  a computer,  knowledge  or  much  help  in  the 
use  of  the  computer,  unscheduled  extensive  use  at  critical 
periods,  and  fast  turnaround  equivalent  to  continuous  man-computer 
interaction.  Except  in  extraordinary  circumstances,  the  con- 
clusion is  that  such  an  operation  is  possible  only  with  a 
dedicated  computer  facility. 

Video  Recording  System  Legibility 

An  electronic  display  (or  a combination  electro-optical 
display)  system  encodes  information  detected  by  the  system 
sensors,  transmits  and  processes  these  signals  electrically  and 
recreates  this  information  in  a symbolic  or  pictorial  format  on 
a display.  In  order  for  the  symbols  so  presented  to  convey 
information  to  the  observer,  the  symbols  must  be  recognizable 
and  identifiable  by  the  observer.  A relatively  large  number  of 
system  and  environmental  factors  impact  upon  the  legibility  of 
the  displayed  symbology;  too  many,  in  fact,  to  be  addressed 
here.  The  three  more  important  factors  as  far  as  the  observer 
is  concerned,  however,  are  the  display  resolution,  the  visual 
angle  of  the  symbol  displayed,  and  the  degree  of  contrast  between 
the  symbol  and  the  display  background • 

literature . A recent  review  of  the  electronic  display 

literature  (Semple,  et  al.,  1971)  suggests  that  the  resolution 
requirements  for  identification  tasks  on  electronic  displays 


n^r-f1^i5iCa^ly1With  lhe  type  of  tar9ets  being  identified,  the 
nature  of  the  display  and  the  environment  in  which  it  was 

recorded.  Several  studies  reviewed  (Shurtleff  and  Owens,  1966; 

,:Shur^;ifff ' et.a1*'  1966)  suggest  that  resolution 
requirements  for  alphanumencs  viewed  under  static  conditions 
are  less  than  for  alphanumerics  viewed  under  dynamic  conditions. 
Likewise,  alphanumeric  targets  required  less  resolution  for 
identification  than  did  geometric  or  more  real-world  symboloqy. 
The  studies  reviewed  were  relatively  consistent  in  their  findings 

a£d  ^gHeS^tha\Yertical  resolution  for  alphanumeric  characters 
should  be  10  to  12  raster  scan  lines  per  symbol  height  for  90%- 
plus  correct  identification.  Geometric  or  pictorial  symbols 
required  a minimum  of  14  raster  scan  lines  per  symbol  height  for 
similar  performance.  These  results  were,  however,  conducted 
under  laboratory  conditions  with  no  visual  or  resolution 
degrading  factors  present  and  assumed  that  the  observer  was 
familiar  with  the  targets  being  identified. 

Hemmingway  and  Erickson  (1969)  reviewed  a number  of  resolu- 
tion  studies  and  conclude  that  a possible  tradeoff  exists  between 
the  number  of  raster  scan  lines  per  symbol  height  and  the  visual 
angie  subtended  by  the  symbol.  As  the  number  of  lines  per  symbol 
height  decreases,  the  same  or  equivalent  performance  levels  may 
be  maintained  by  increasing  the  angular  subtense  of  the  symbol. 
This  tradeoff  holds  for  symbols  with  visual  angles  between  7.8 

atd*h™  °l  arc;  The5e  appears  to  be  an  asymptote,  however, 

at  about  16  minutes  of  arc  (see  Figure  7) . 

Another  important  consideration  in  electronic  displays, 

used  in  an  airborne  environment,  is  the  contrast 
S5**®*}  displayed  symbol  and  the  display  background  (or  the 
light-dark  contrast  of  pictorial  displays) . The  higher  the 

Hnfofi31110',,1?6  higher  the  probability  of  correct  identifica- 

Jhf  r^Ltht  Sym^>1  u?der  a wide  range  of  viewing  conditions.  For 
the  present  application,  a contrast  of  about  8/1  to  10/1  should 

?LSUfflCiSn5'  Pf?vided  consideration  also  is  given  to  the  nature 
and  amount  of  ambient  illumination  present  in  the  cockpit. 

Contrast  greater  than  this  is  generally  beyond  the  capability  of 
standard  TV  systems.  ^apsoiiity  or 

. Ttie  eroount  of  ambient  illumination  present  in  the  cockpit 
environment  will  directly  influence  -the  legibility  (contrast)  of 
racorded . The  amount  of  illumination  incident 
«^>L?hf«21KPluy  fa°f  Wl11  deteriorate  the  contrast  between  the 
SKf  a?d  background.  The  amount  of  illumination  incident  upon 
the  display  face  plus  the  reflectivity  of  the  display  face 
“j”e5iaf  are  the  Primary  factors  producing  display  "washout",  in 
the  latter  case,  not  only  is  the  contrast  of  the  display  degraded, 
^ur  1^ense  ambJent  illumination  is  reflected  (produces  glare) 
into  the  recorder/sensor,  saturates  it,  and  thereby  reduces  its 

aad  dark*  Through  the  use  of  antiref lective 
coatings  and  filters,  in  conjunction  with  high  brightness  symbols 
nL?  ?ay  surface  contrast,  display  washout  may,  for  the  most 
part,  be  overcome  (Semple,  et  al.,  1971). 
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(SHURTLEFF,  1967) 


(ERICKSON,  1969) 


ANGULAR  SUBTENSE  (MINUTES  OF  ARC) 


Trade-Off  Bands  for  Angular  Subtense  Versus  Line 
Number  for  Four  Levels  of  Performance 
(from  Bruns,  et  al.,  1970). 


. . * nun^-er  of  factors  limit  the  utility  of  the  above  resolu- 

tion  data  m predicting  resolution  requirements  for  airborne 

®<3ulPment*.  Obviously,  one  factor  is  the  static  nature 
oi  the  displays  used  in  the  above  studies  contrasted  to  the 
dynamic  nature  of  operational  airborne  environments.  In  the 

anit^h«e^ir°nm?n^'  instrVmeilt  readings  are  constantly  changing, 
and  the  external  imagery  is  m constant  flux  as  a result  of 

qn^ffLC??nging.airCfa-t  attitude  and  performance  parameters. 

?*llY'  external  imagery  is  continually  changing  in  size, 

?dd  to°thI^  ?hntfaS^'1-Knf  orientation  as  the  aircraft  maneuvers. 

, to  these  the  fact  that  overall  image  quality  is  degraded  in 
airborne  systems  as  a result  of  aircraft  interference  (EMI, 

9~foif<;fs'  etc.),  and  atmospheric  attenuation  (haze, 
fapid*y  changing  ambient  illumination  and  contrast 
levels,  etc.),  and  the  value  of  laboratory  resolution  data 
appears  limited  indeed. 

Q„e*  second  consideration  is  the  fact  that  the  human  visual 
system  is  degraded  by  many  of  the  factors  that  affect  display 

raDidTvrw??JU^h°n:  .vi®ual.**uity,  f°r  example,  deteriorates 
rapidly  with  the  introduction  of  high  rates  of  acceleration, 

dISJirif  vel°ci!:y  ?nd  vibration.  Miller  (1962)  found  that  acuity 
degrades  relatively  slowly  at  angular  velocities  of  from  10  to  30 
degrees  per  second.  With  angular  velocities  above  30  degrees  per 
second,  however,  acuity  degrades  xapidly.  (Angular  velocity,  in 

bo^r  incl“ded  rotation  of  the  display,  the  observer,  and 

both  display  and  observer.)  Van  Der  Brink  (1969)  suggests  that 

thP  !S8SS  °f  an  1I?’a9e  on  a screen  is  determined,  in  part,  by 
SiahESii^l  Pr°?ertles  of  the  eye  it^lf.  He  found  that  the 
veloci??  of  tar9ets  had  to  be  increased  as  the  angular 

If  targets  was  increased  to  maintain  the  same  level 

tfraets^  perforJ"fn°e-  His  -data  suggest  that  low  contrast 

television,  which  are  just  above  the  observer's  visual 

£e£e  introduced?  C,  W°Uld  dr°P  bel°W  th3t  threshold  if  motion 

the  rP<Sn?^dAf°ft  °i  consideration  is  suggested  by  the  fact  that 
Ki7n  hXt  number  of  studies  (reviewed  in  Semple,  et  al., 

inni \ * that  m?dest  decreases  in  resolution  or  contrast  and 

afff^  increases  m environmental  degradation  may  not  individually 
affect  target  identification  performance.  When  combined,  however 

JohnsonC??gfift?dUf tl0nS  in  identif: ication  performance  occur. 

Johnson  (1968),  for  example,  compared  displays  using  5,  7,  and  9 

f ?*ay<-and  fou2d  no  significant  difference  in  detection 
and  identification  performance  in  her  subjects,  as  long  as 
horizontal  resolution  was  held  constant.  When  horizontal 
resolution  was  reduced  (from  525  lines  to  400  lines  to  200  lines), 
howevter , performance  deteriorated  as  the  number  of  shades  of  gray 

1969reB^nf*  e?hAireSVi^°f  studieS  (Gould,  1968,  D'AfutO^ 

iQ7n(  Bruns'  et  a1*'  1970)  and  reviews  (LUxemberg  and  Kuehn, 

™mber  of  other  display  parameters  interact 
in  a non- additive  fashion  to  affect  display  resolution.  There- 

fr°^  studies  that  attempt  to  isolate  and  examine 
individual  parameters  must  be  accepted  with  caution. 
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!In  an  effort  to  control  for  some  of  the  above  discussed 
variables,  Bruns,  et  al.,  (1970)  conducted  a study  to  examine 
target  identification  accuracy  on  a television  display  as  a 
function  of  several  target  motion  rates,  display  degradation 
levels  and  aircraft  flight  profile  conditions.  Air-to-surface 
attacks  were  simulated  by  video-taping  actual  reconnaissance 
transparencies  of  real-world  targets  (oil  storage  tanks,  bridges, 
SAM  sites,  etc.).  Aircraft  speeds  were  simulated  at  between 
150  and  900  knots  with  dive  angles  varying  from  10  to  60  degrees. 
Attack  runs  commenced  at  altitudes  ranging  from  8,000  to  46,000 
feet  and  terminated  at  altitudes  of  from  800  to  4,600  feet.  All 
targets  were  presented  across  all  major  independent  variables. 

Sony  Model  120A  (3.5  megahertz)  video  recorders  were  used  to 
record  the  attacks  while  four  525-line  TV  monitors  (5x7  inch 
with  degraded  resolution,  5x7  inch  nondegraded,  3.4  and  4.4  inch 
and  a 2.4  x 3.0  inch)  were  used  to  display  the  films  to  the 
subjects.  Ambient  room  illumination  along  the  subject's  line  of 
sight  was  approximately  50  foot-Candles . The  subject's  task  was 
to  identify  targets  as  quickly  as  possible  on  the  televised 
displays  that  correspond  to  circled  targets  on  briefing 
photographs. 

A number  of  interesting  conclusions  are  observed  as  a result 
of  this  study.  For  one  thing,  the  results  indicate  that  the 
video  target  "attacks"  preceded  to  a given  point  in  the  missions 
whereupon  the  subjects  identified  the  targets.  Each  target  was 
identified  at  the  same  time  during  the  attack,  regardless  of  the 
display  being  viewed.  Bruns  interprets  this  to  mean  that  the 
number  of  raster  scan  lines  passing  through  the  target  is  the 
critical  parameter  affecting  identification.  Since  the  number  of 
lines  was  identical  on  the  four  different  size  monitors  and  each 
monitor  was  displaying  the  same  video  tape,  the  number  of  scan 
lines  passing  through  the  target  at  any  point  in  the  simulated 
attack  is  also  identical.  (Individual  lines  are  proportionately 
smaller  on  smaller  monitors,  but  they  subtend  the  same  visual 
angle  when  the  angle  subtended  by  the  various  sized  displays  is 
held  constant.) 

Secondly,  Figure  8 indicates  that  dynamic  real-world  targets 
used  in  this  study  required  larger  angular  size  and  more  scan 
lines  per  target  height  than__did  the  symbols  used  in  earlier 
studies  for  equal  probability  of  detection.  (It  might  be  noted 
that  the  symbols  used  in  the  Hemmingway  and  Erickson  study  were 
of  equal  size  and  uniformly  high  contrast  while  the  targets  used 
in  this  study  had  neither  uniform  size  nor  contrast.) 

Field  studies.  In  1970,  the  Air  Training  Command  conducted 
a flight  evaluation  of  a relatively  inexpensive  commercial 
television-camera  video  recording  system  installed  in  an  F-4E 
aircraft.  The  purpose  of  the  evaluation  was  to  examine  the 
feasibility  of  using  this  type  of  system  in  an  airborne  environ- 
ment and  to  examine  the  training  potential  offered  by  immediate 
mission  playback  as  soon  as  the  mission  is  over.  The  equipment 
consisted  of  two  small  TV  cameras,  a briefcase  size  video  recorder 
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(produced  by  Sony)  and  specia).  electronics  to  mt<  rate  the 
imagery  from  the  two  cameras  onto  a single  tape.  Me  associa  « 
ground  equipment  consisted  of  a standard  (Sony)  CV-2100  playback 
deck  and  TV  monitor. 

The  results  indicate  that  Tow  playback  resolution  prevented 
precise  assessment  of  some  release  condi tion  parameters  on 
virtually  all  air-to-ground  passes.  Certain  instruments  (pipp^r 
placement,  draft,  bank  angle),  however,  were  readily  discernable. 
Pipper  tracking  of  maneuvering  aircraft  targets  could  be 
adequately  recorded  to  4 Gs,  but  beyond  this  point,  the  picture 
quality  degraded  at  an  accelerated  rate.  In  general,  it  was 
felt  that  the  200  lines  of  horizontal  resolution  possible  in  tne 
DVK-2400  TV  camera,  video  recorder  and  playback  equipment  was 
not  sufficient  to  warrant  use  of  this  equipment.  The  study 
recommended  a 500  line  TV  system  would  be  desirable  (a  minimum  or 
300  lines  required)  for  use  in  this  context. 


Another  study  was  conducted  by  the  Tactical  Fighter  Weapons 
Center  at  Nellis  AFB  using  upgraded  equipment  installed  in  an 
A-7D.  The  equipment  included  a (Sony)  AV-3400  video  recorder  an 
Vidicon  Camera,  a control  unit,  and  a small  combining  glass  anc 
glare  shield  mounted  in  front  of  the  HUD  combining  glass. 
(Equipment  described  in  TAC— TR— 70A— 113F . ) 

The  results  of  this  study  indicate  that  the  commercially 
available  off-the-shelf  equipment,  when  used  as  a gun  camera 
system,  was  able  to  record  HUD  symbology  and  ground  references 
or  target  areas.  With  a few  minor  modifications,  the  off-the 
shelf  components  were  reliable  when  used  in  aircraft.  The  stuay 
found  that  the  immediate  playback  capability  provided  by  the 
video  recorder  greatly  enhanced  mission  critique  by  allowing  the 
pilot  to  review  the  mission  while  the  details  of  the  mission  were 
still  fresh  in  his  mind.  Recommendations  for  additional  improve- 
ments in  the  video  recording  system  were  also  provided  (sum- 
marized in  Table  14) . 


Based  on  the  above  studies  and  recommendations  found  in  the 
display  literature,  a summary  of  the  technical  specifications 
for  a typical  video  recording  is  presented  in  Table  15  for  the 
Vidicon  Camera  and  in  Table  16  for  the  video  recorder.  While 
field  studies  of  video  recording  equipment  have  concluded  that  a 
minimum  resolution  of  300  lines  is  needed  for  training  purposes, 
research  in  the  available  literature  indicates  that  minimum 
resolution  of  400  lines  is  more  likely  to  be  acceptable. 

Further,  contrast  of  700-800  percent  and  8-10  shades  of  gray 
should  be  added  to  this  specification.  It  is  noted  that  these 
specifications  are  to  serve  as  guides  only,  and  are  by  no  means 
absolute.  Additional  field  and  laboratory  studies  are  required 
to  verify  the  above  specifications,  to  arrive  at  optimum  con- 
figuration of  the  recording  equipment  in  various  cockpits,  and 
to  ascertain  precisely  which  flight  instruments/real-world  image 
combinations  are  best  for  given  missions. 
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TABLE  14.  SUGGESTED  EQUIPMENT  AND  CONFIGURATION 
IMPROVEMENTS  (TAC-TR-7  0A- 1 1 3F) 


Brightness  controls  for  indicator  illumination  levels. 

Indicator  showing  recording  time  remaining  on  the  tape 
presently  installed. 

Provisions  for  an  audio  call  button  to  permit  the  pilot  to 
verbally  annotate  tapes  without  necessity  of  transmitting 
over  the  radio  at  same  time. 

Pilot-operated  controls  should  be  configured  for  left  (ox- 
right  ) hand  control,  depending  upon  placement  in  aircraft 
cockpit. 

Pilot  operated  controls  should  be  configured  for  visiblity  in 
either  right  or  left  hand  configuration. 

Remove  existing  (Sony)  potentiometers  in  camera  control 
units  and  replace  them  with  trimpots  centrally  located  in  area 
which  is  accessable  from  outside  (for  ease  of  adjustment) . 

This  allows  find  boresight  adjustment  to  be  accomplished 
electrically  with  the  vidicon  horizontal  and  vertical 
centerling  pots. 

Include  an  audio  filter  circuit  to  eliminate  aircraft  electro- 
magnetic interference  (EMI) . EMI  can  be  isolated  from  the 
recording  unit  by  the  addition  of  a 500  ft  audio  transformer. 

The  control  pack  video  monitor  should  be  realigned  for 
inflight  viewing  by  the  pilot  (or  completely  removed,  as  it 
cannot  be  seen  in  its  present  position) . 

Require  dual  (gunsight  and  instrument  panel)  recording 
capability  - Split  Image  recording. 

Lens  should  be  locked  in  the  f/5.6  position  with  focus  at 
infinity  to.  avoid  accidental  changes  in  flight.  This  setting 
was  most  effective  in  previous  studies. 

Replace  the  5-position  mode  selection  switch  with  a 4-position 
switch  and  relocate  said  switch  so  that  the  pilot  can  view  and 
manipulate  it  while  inflight. 

Mode  indicator  lamps  are  not  required  since  they  are  too  dim 
for  daylight  viewing  and  too  bright  for  night  operation. 

It  might  be  possible  to  remove  light  baffle  by  fabricating  a 
polarized  beam  splitter  and  using  a polarized  filter  on  the 
vidicon  lens. 
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TABLE  14.  SUGGESTED  EQUIPMENT  AND  CONFIGURATION 
IMP  ROVEMENTS  (TAC-TR- 7 0 A- 1 1 3F ) ( Con t . ) 


Add  a slide  arrangement  on  the  recorder  unit  itself  to 
facilitate  film  change  and  unit  maintenance. 

If  a fixed  lens  is  used,  a 25mm  lens  is  recommended  over  the 
standard  17mm  lens  to  increase  FOV. 

Install  a permanently  attached  lens  cover  for  use  when  camera 
is  not  in  operation.  It  should  be  designed  for  easy  removal 
and  replacement,  but  should  not  swing  freely  when  not  in  use. 

Camera  should  be  mounted  vertically  instead  of  horizontally 
to  minimize  the  effects  of  vibration. 

If  Sony  model  2400  is  selected,  the  automatic  shut  off  wire 
whould  be  bent  so  as  to  hold  tape  against  the  recording  heads 
during  negative  g's. 

Include  an  audio  signal  to  indicate  manual  weapon  release 
time.  A 28V  input  from  the  pickle  switch  (4-10  seconds  at  1,000 
cps)  would  do  nicely. 


VIDICON  TUBE: 


TABLE  15 

VIDEO  CAMERA  SPECIFICATIONS 


SCANNING  SYSTEM: 

SYNC  SYSTEM: 

HORIZONTAL  RESOLUTION: 

VERTICAL  RESOLUTION: 

VERTICAL  FREQUENCY: 

SIGNAL-TQ-NOISE  RATIO: 

VIDEO  OUTPUT: 

AMBIENT  ILLUMINATION 
SENSITIVITY  CONTROL 
RANGE  (AUTOMATIC): 

LENS  (ZOOM  TYPE): 

LENS  (FIXED) : 

VIEWFINDER: 

MICROPHONE: 

POWER  REQUIREMENTS: 
POWER  CONSUMPTION: 
AMBIENT  TEMPERATURE: 
FILTERS  REQUIRED: 


Diode  Matrix  Vidicon 
Standard  2:1  Interlace 
External  or  Internal 

500  Lines  Desired,  400  Lines  Minimum 
500  Lines  Desired,  400  Lines  Minimum 
60  Hertz 

Greater  than  400  dB 

IV  (p-p)  Composite  Video  Signal,  50  ohms 

25  - 10,000  Foot  Candles 

12>s  to  50  mm,  f/2,  C-type  mount 

25  mm,  f/2,  C-type  mount  - outside  viewing 
17  mm,  f/2,  C-type  mount  - cockpit  panel 

viewing 

Built-in  Viewfinder/Monitor,  1 inch  Tube 
Electret  Condenser  Microphone 
12V  DC 
8W 

32°  to  105°  F 

Medium  Green  (Used  to  Optimize  HUD 
Symbology  Contrast 
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TABLE  16 


VIDEOCORDER  SPECIFICATIONS 


VIDEO  RECORDING  SYSTEM: 


Rotary  dual-head  helical  scan  with 
full  field  designed  to  American 
TV  standards. 


HORIZONTAL  RESOLUTION: 
VERTICAL  RESOLUTION: 


500  lines  desired,  400  lines  minimum. 
500  lines  desired,'  400  lines  minimum. 


TAPE  WIDTH: 

TAPE  SPEED: 

TAPE  PATTERN: 

VIDEO  MODULATION: 

VIDEO  SIGNAL-TO-NOISE 
VIDEO  INPUT: 

VIDEO  OUTPUT: 

RF  OUTPUT: 

AUDIO  OUTPUT: 

AUDIO  INPUT: 

AUDIO  FREQUENCY  RESPONSE: 
AMBIENT  TEMPERATURE: 
POWER: 

POWER  CONSUMPTION: 
RECORDING  TIME: 

CONTRAST 
SHADES  OF  GRAY 


Standard  H inch. 

7*s  inches  per  second. 

EIAJ  type  I VTR. 

Frequency  modulation. 

Ratio  greater  than  40  dB. 

l.OV  (p-p) , 75  ohms,  unbalanced. 

l.OV  (p-p) , 75  ohms,  unbalanced. 

75  ohms,  80  dB. 

(Microphone  Input)  3.6K  ohms,  -75  dB,  AGC. 
(Earphone  Output)  High  impedance  type. 

100  Hertz  to  10K  Hertz. 

32°  to  105°  F. 

DC,  12V 

AC,  117V  10%  with  use  of  AC  adapter. 

12W  @ 12V  DC. 

30  minutes  minimum. 

700  - 800  Percent. 

8-10 
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Airborne  Instrumentation  Data 


Sources.  A number  of  visits  were  made  to  obtain  data^ about 
costs,  personnel,  equipment,  operations  and  schedule  to  allow 
comparison  between  electronic  airborne  instrumentation  and  other 
alternatives.  Visits  were  made  to  some  of  those  considered  to  be 
most  experienced  in  airborne  instrumentation  operations,  i*e., 
the  airframe  manufacturers  who  must  constantly  flight  test  their 
products.  Other  manufacturers  also  involved  in  flight  instrumen- 
tation were  sampled.  The  survey  was  by  no  means  complete  or 
highly  structured;  the  information  which  resulted  was  approxi- 
mate, rule-of-thumb,  or  statement  of  extreme  cases.  It  would 
therefore  be  unfair  to  associate  specific  experience  or  cost  data 
with  particular  manufacturers.  Although  it  would  be  desirable  to 
credit  individuals  and  companies  by  name,  no  specific  identifica- 
tions will  be  made. 

Statement  of  problem.  The  requirements  for  training 
performance  measurement,  including  a preliminary  list  of 
parameters  and  alternative  system  types  to  be  compared,  were 
discussed  during  these  visits,  resulting  in  the  model  form  shown 
in  Figure  9.  Analysis  of  combat-crew  training  information  needs 
has  indicated  that  a total  of  more  than  90  parameters  may  be 
required  for  measurement  throughout  all  phases  of  flight  training, 
but  no  more  than  about  20-30  parameters  need  to  be  recorded 
during  any  given  training  phase.  A patch  panel  is  used  to  select 
the  parameters  for  recording  during  a specific  flight.  Recording 
is  accomplished  on  a magnetic  tape  in  a pulse  code  modulation 
(PCM)  format  if  state-of-the-art  technology  is  to  be  used; 
otherwise,  frequency  modulation,  pulse  duration  modulation,  or 
pulse  amplitude  modulation  techniques  may  be  used  in  the  degree 
of  sophistication  of  PCM  is  not  warranted.  Conversion  equipment 
appropriate  to  the  form  of  modulation  will  be  needed  to  obtain 
quick- look  data,  or  second-generation  measurement,  through  the 
use  of  a general-purpose  digital  computer.  Of  course,  the  nature 
of  facilities  needed  must  be  considered  in  a full  definition  of 
an  instrumentation  system  and  a complete  assessment  of  costs.  A 
large  proportion  of  the  total  costs,  and  degree  of  system  success, 
is  due  to  the  equipment,  personnel,  parts,  documentation  and 
logistics  associated  with  system  calibration,  operation, 
maintenance  and  repair. 

Flight  test  operations.  The  costs  of  flight  test  instrumen- 
tation were  discussed  within  the  context  of  the  system  model 
shown  in  Figure  9;  however,  prior  to  detailed  discussion  of 
these  cost  estimates,  the  nature  of  flight  test  operations  in 
most  airframe  companies  should  be  understood. 

First,  no  detailed  breakdown  of  costs  is  available;  conse- 
quently, accurate  cost  estimates  of  any  system  are  not  possible. 

A given  instrumentation  engineer  may  be  working  on  a number  of 
programs  at  any  time;  instrumentation  problems  tend  to  grow 
like  Topsy;  and,  instrumentation  costs  are  generally  buried 
among  other  program  costs. 
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Second,  flight  test  instrumentation  operations  include  all 
of  the  following  phases: 


(1)  Instrumentation  system  design. 

(2)  Instrumentation  calibration. 

(3)  Test,  diagnostics,  maintenance. 

(4)  Spare  parts  inventory. 

(5)  Equipment  calibration. 

(6)  Quick- look  capability. 

(7)  Repair  shop. 

(8)  Ground  test  equipment. 

(9)  Analog/digital  conversion  and  play-back  equipment. 

(10)  Configuration  and  efficiency  bookkeeping. 

The  overall  costs  include  contributions  from  each  of  the  above 
phases,  and,  any  estimates  of  an  airborne  instrumentation  system 
ke  based  on  cost  experience  reflecting  such  an  operation. 
The  specific  cost  items  corresponding  to  Figure  9 are: 


(1)  Aircraft  fabrication,  including  wiring  and  installation 
of  sensors. 

(2)  Instrumentation  and  recording  system. 

(3)  Conversion  equipment. 

(4)  Test  stand  and  test  equipment. 

(5)  Spares. 

(6)  Documentation.  ' 

(7)  Design,  integration,  and  operating  personnel. 

(8)  Return  of  aircraft  to  original  condition. 

The  operation  is  not  perceived  to  be  as  extensive  or  detailed  as- 
that  required  for  flight  test;  however,  cost  estimates  for  the 
preceding  eight  items  will  reflect  flight  test  experience. 

Last,  instrumentation  for  flight  test  is  entirely  first- 
class;  there  is  little  room  for  any  second-rate  equipment  or 
procedures  which  may  permit  the  loss  of  extremely  valuable 
flight  test  data  (e.g.,  may  reflect  on  causes  for  the  loss  of  a 
prototype  aircraft) . Much  of  the  flight  instrumentation 
electronics  may  be  specially  designed  by  the  instrumentation 
engineers,  manufactured  in  small  assembly  lines,  and  stocked  in 
extensive  inventories — all  at  the  facilities  of  the  airframe 
manufacturer.  Accuracies  of  less  than  1%  are  achieved  through 
the  use  of  precision  sensors,  special  calibration  at  specialized 
laboratories  of  expensive  facilities,  and  complex  corrections 
during  data  processing.  All  in  all,  flight  test  operations  are 
exceedingly  expensive  and  probably  more  expensive  than  the 
requirements  for  combat-crew  training  dictate;  therefore, 
compensations  must  be  made  when  using  flight  test  experience  for 
predicting  training  measurement  system  costs. 

Five  cases . As  might  be  expected,  data  obtained  from 
various  sources  differed  since  the  assumptions  made,  approaches, 
specific  experience  and  hardware  used  generally  differed  from 
manufacturer  to  manufacturer.  The  range  of  data  collected  is 
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typified  by  five  cases  which  are  summarized  in  Table  17;  each  of 
these  is  more  fully  discussed  in  the  following  paragraphs. 

Cases  I,  II , and  III.  The  estimates  obtained  in  Cases  i,  II, 
and  III  are  based  on  a definition  of  the  problem  closely  cor- 
responding to  the  model  presented  in  Figure  9.  These  estimates 
indicate  that  the  cost  of  instrumenting  one  aircraft  (wire  90 
channels  and  record  20-30  at  any  given  time)  with  associated 
equipment  for  operation  and  repair  may  range  between  $716,000  and 
$1,200,000.  It  should  be  understood  that  the  grossest  rules-of- 
thumb  for  estimating  overhead  and  genera 1-and-administrative 
rates  have  been  made.  Approximately  one  year  lead  time  is  needed 
prior  to  detailed  checkout  of  the  system;  the  aircraft  will  be 
needed  for  installation  for  the  majority  of  this  time.  The  flight 
test  of  a training  measurement  instrumentation  system  could 
become  lengthy  and  expensive  if  acceptance  testing  were  conducted 
for  each  phase  of  training  (transition,  instruments,  formation, 
air  combat,  ground  attack,  air  refueling,  air-air  intercept,  etc.). 
Various  amounts  of  operating  labor  were  predicted,  depending  on 
(1)  assumption  that  system  accuracy  and  complexity  would  be  like 
that  used  in  flight  test,  (2)  the  reliability  of  the  equipment 
(which  is  ordinarily  unknown  for  long-term  repetitive  use) , and 
(3)  the  assumed  intensity  of  the  flight  schedule.  Highly  complex 
flight  test  instrumentation  requires  a large  crew  to  calibrate, 
test,  and  maintain;  very  large  crews  are  required  to  sustain  a 
flight  schedule  of  as  much  as  two  flights  a day.  Hopefully, 
measurement  equipment  for  training  research  can  be  simpler  and 
more  reliable;  however,  if  not,  it  may  not  be  possible  to  keep 
pace  with  normal  experimental  schedules  with  such  equipment. 

Case  IV . The  fourth  case  is  based  on  the  use  of  a miniature 
commercial  airborne  computer  which  can  accept  most  of  the  signal 
forms  normally  available  from  airborne  sensors  and  format  the 
digitized  signals  on  a cassette-type  incremental  tape  recorder 
with  a standard  IBM  head.  In  addition  to  recording,  such  a 
computer  could  also  compute  measures  for  direct  read-out.  A 
further  assumption  associated  with  Case  IV  is  that  aircraft 
modification  and  wiring  would  be  performed  by  USAF  personnel  or 
another  contractor.  The  suggested  devices  are  reported  to  be 
highly  reliable  with  a mean-time-between-failures  of  approximately 
1500  hours;  on  this  basis,  only  occasional  maintenance  is 
assumed  to  be  necessary.  An  approximate  cost  estimate  for 
sufficient  equipment  and  services  for  four  aircraft  is  $750,000; 
additional  costs  of  wiring  four  aircraft  for  90  channels  of  data 
(at  approximately  $2,000  per  channel)  is  about  $720,000,  bringing 
the  total  to  about  $1,470/000.  This  estimate  is  significantly 
lower  than  the  cost  estimates  found  in  Cases  I-III,  but  it  is 
based  on  equipment  much  different  than  that  normally  used  in 
flight  test.  It  should  be  noted  that  some  integration  and 
checkout  costs  may  also  not  be  included  in  this  cost  estimate. 

Case  V.  The  last  case  is  interesting  because  it  goes  beyond 
the  model  shown  in  Figure  9 to  include  digital  computer  facilities 
and  a multiple-target  tracking  radar.  A facility  of  this  type  is 
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and  is ^esirabl^f or°mos t atrainint  dJJring  air  combat  maneuvers, 
for  such  a facility*  ^SludfSu  h!  PhafeS*  The  cost  estimated 

approximately  $1,600,000  to  $1  800  OO^f  °f.Wirin9  aircraft,  is 
however,  the  initial  Zf  ° 51,800,000  for  four  aircraft; 

$16,800  per  week  recurrintf1^  °yershad°wed  by  the  estimated 

largely  due  to  the  number  of ^eople^JqJire^f119  C°- tS  ^ 
operation  (about  16  people).  P Pi  re<3uired  for  maintenance  and 

equipment  required  to^btain6^1^9^65  °f  costa'  Procedures  and 
through  an  airborne  instrumentatiS^9  parformance  measurement 
data  obtained  are  incSncSusiSe  wS  E®  quite ■ ™ried-  The 

system  or  in  bracketing  the  costs.  g d to  a specific  type  of 

enough  aircraft^  permit1coilectina°Dalf C°St  f°r  instrumenting 
10  students  throughPtrainina  i«=  pe^formance  data  on  about 

alternative  is  available,  it  follow?9^1?9*  If  any  less  exPensive 
eliminate  the  need  for  meacnro!  ! ws  that  one  should  reduce  or 
digital  recording  syst6m?aSUrement  thr°Ugh  an  instrumented 

reliability  of  the^ystem^hould  hS  f°Un^  to  be  necessary,  the 
reliability  is  a keyYf actor  ?n  n ^ eJainined  closely.  System 
engineer  and  technician  nPrcn  f reducing  the  need  for 
facilities  and  spaJes  aL  al°ng  With  extensive  repair 

can  keep  pace  with  intensive  fliaht^0?  data  collection 

is  perhaps  the  more  important.  The  first^ed’  ThG  second  fact°* 
associated  with  svsi-^m  ine  tirst  reduces  costs 

needed  information  to  be  collected'*  If 6 Second  factor  permits 
does  not  work  frequently  enouah  a measurement  system 

then  there  is  little  reason  fir  its  exi^ence!^  lnformatlon’ 

time  an  air^rff ttmust°behwitL?aw0fJom0nCer"  iS  the  amount  of 
of  modification  for  an  instrum^n??^  service  for  the  purpose 
indicate  that  an  aircraft  Lv  system.  Various  estimates 

useful  Existence  If  S^a^il”^^ 

costs  of  withdrawing  U 

high  recurring  cost . ^Thes^costs hY  ^aSG  V indicates  the 
the  value  of  ?he  research  ?owa^  ^-SJ  bG  ^stifled  in  terms  of 
tributes.  The  value  of  res ea^h  flch  such  an  operation  con- 
unless  the  specifics  are  known  nS  P°ssl^^e  to  estimate 

such  a facility  an^crew  mnsn  K °"  t?e  other  hand'  it  is  clear 
productive  fashion-  il  be  regularly  occupied  in  a 
implied.  Iaslllon-  a high-level  continuous  operation  is 
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Personnel  Requirements 

Eli 

S«”JUrM°P»pa«“~eis«r“e~3?e  and  monitor  programs 

Sisb^s.^ 

during  "the  v^to^  ^^“00^0^^^^ 

inzti^i o sssi  rrs’SEoSs's*;  ss-ss-t.  *&»i 

recording  in  approximately  ll  assumed  that 

onelindividual°should  be  able  to  Pj»<W”  £|.f  “^med^y''98  3 

S^iSSJJTSS^ 

Ui?St  SET  coni9lIcationy,(su=hSasretranLription  of  audio  recordings) 
and  to  prepare  technical  reports. 

ca1ibrate?nreplaceaandtrepairimeasurement*«quipment*istmuch  more 
difficult  to  specify  since  ’:his  ^®?®"^1"0iie?tedefromCvarious 

concerns^performing"^ light" tests"hare Varied  widely ) estimates 

collected  from  commercial  avionics  concerns: indicate  tl hat  a 
significant  improvement  in  reliability,  with  re  uc.  . 

engineer/ technician  labor,  is  possible.  Srnce  equipment 
complexity  should  be  less  for  performance  measurementth 

~ SS  as  a-  - “ 

Based  on  these  estimates  a manloading  is  developed  in  Table 
19  for  manual  and  automatic  measurement  processing, 
four°f lights^ a day  Note  that  engineer  -d  technician  labor 

ap?rc2fsesndeTenSroea  tLSlTSSnS  5 SSJ2&  - Rights 

which  may  occur  on  a given  day)  tha^suppor^oipfour 'aircraft 
assumed  that  these  are  the  same,  that  support  or 

result  in  four  flights  per  day. 

Note  that  an  automated  system  apparently  results  in  increased 
rather  than  a reduction,  and  that  the  primary  benefit 

of  "automation  i^mor^accur  ate  dati  in  greater  quantities. 
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TABLE  18, 


Research  Scientest 
Programmer 

Data  Clerk 


PERSONNELL  ASSUMPTIONS 
LEVEL  REQUIRED 

One  lead,  one  per  daily  flight. 

One  system  programmer  first 
year,  one  thereafter  if  four 
or  more  flights  per  day. 


Engineer/Technici 


an 


Manual ; 

Auto : 

Manual: 

Auto: 


Secretary 


One  for  two  flights 
per  day,  double  for 
data  verification. 

One  for  two  flights 
per  day  for  computer 
operations . 

One  tech,  for  two  acrft. 

One  eng.  for  2 acrft, 
two  tech,  per  acrft. 

??ef™0hnician  for  9r°und  equip., 
if  four  or  more  acrft. 

clerical  assistance  and 
report  preparation. 


TABLE  19.  MANLOADING*  WITH  DIFFERENT 

SYSTEMS  AND  DEGREES  OF  UsLe 


Research  Sci. 
Programmer 
Data  Clerk 
Eng. /Tech* 
Secretary 
Total 

and 
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If  a ground  station  radar  is  to  be  maintained  for  flight  track- 
ing, two  radar  technicians  should  be  added  to  these  estimates. 
Field  service  contracts  for  service  of  the  computer  and  other 
larger  pieces  of  equipment  will  also  be  needed. 
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III.  DESIGN  TRADEOFFS 


The  design  analyses  result  in  tradeoff  comparisons  at  two 
levels:  (1)  comparison  of  competing  data  sources,  i.e.,  audio, 

x-Y,  video/photo,  and  instrumentation  (digital  recording),  and 
) comparison  of  systems  built  around  only  video/photo  sensors 
and  only  digital  recording.  Tradeoff  comparisons  at  the  first 
level  reveal  the  rule  of  alternative  data  sources,  while  second- 
level  comparisons  establish  cost-effective  system  combinations. 

Alternative  Data  Sources 

Audio.  Recording  of  voice  communications  was  found  to  be 
of  value  in  all  phases  of  combat-crew  training.  Since  audio  re- 
cording is  relatively  inexpensive  and  simple  to  implement,  there 

no  apparent  reason  to  exclude  auditory  data  from  a measurement 
system. 


Audio  recordings require  manual  data  processing  methods  and 
often  must  be  synchronized  with  other  recorded  information  to  be 
ot  value.  Auditory  information  is  particularly  valuable  for 
measurement  related  to  crew  coordination,  but  voice-operated 
relays  must  be  used  to  uniquely  identify  which,  crewmember  is 
talking,  even  if  two  attempt  to  talk  simultaneously. 

— • The  cases  where  X-Y  data  are  required  for  measurement 
ave  been  considered  carefully  since  these  portend  the  use  of 
expensive  equipment  (such  as  a multiple-target  tracking  radar) 
and  the  collection  of  dif f icult-to-process  recordings.  It  was 
therefore  interesting  to  find  cases  where  equivalent  results 
could  be  obtained  with  video/photo  sensors  (not  in  the  form  of 
a tabulation  of  X-  and  Y-values,  but  position  information  such  as 
the  relationship  between  tanker  and  refueling  aircraft  from  the 
tanker  lights). 


All  cases  of  X-Y  data  requirements  uncovered  in  the  current 
analyses  are  listed  in  Table  20,  showing  that  most  requirements 
can  be  met  with  video/photo  recording.  If  video/photo  recording, 
with  manual  processing,  is  adopted  then  many  of  the  problems 
associated  with  X-Y  data  are  resolved.  Table  20  also  reveals 
that  a number  of  parameters  are  not  obtainable  with  video/photo 
sensors;  these  are:  (1)  lateral  drift  across  the  runway  during 

transition,  (2)  relative  position  of  aircraft  during  intercept 
to  lockon,  (3)  enroute  cross-track  error  during  airdrop, 

' inflight  ranging  (out  of  sight)  during  formation,  and  (5)  space 
paths  of  multiple  aircraft  during  air  combat  maneuvers.  P 


It  has  been  previously  pointed  out  that  a multiple- target 
tracking  radar  is  quite  expensive  (current  radar  approximately 
$1-3  million;  future  laser  versions  estimated  at  $300,000)  and 
require  two  radar  technicians  to  operate  and  maintain  it.  Unless 
sustained  critical  research  is  planned,  it  may  be  preferable  to 
operate  within  existing  instrumented  ranges  (e.g.,  Edwards  AFB, 


94 


TABLE  20.  REQUIREMENTS  FOR  X-Y  DATA 


PHASE 


TRANSITION 


PARAMETER 


OBTAINABLE  WITH 
VIDEO/PHOTO  ? 


INTERCEPT 
(PRIOR  TO  LOCKON ) 


AIR  REFUELING 


AIR  DROP 


FORMATION 


GROUND  ATTACK 


DART  FIRING 


AIR  COMBAT 


GROUND  TRACK 

RA* 

CENTERLINE  DEV 

RA 

LAT.  DRIFT 

No 

THRESHOLD 

RA 

DIST.  DOWN  RNWY 

RA 

SPACING 

RA 

TGT.  AZIMUTH 

No 

TGT.  ELEVATION 

No 

TGT . RANGE 

No 

TGT.  RANGE  RATE 

No 

TGT.  ASPECT  ANGLE 

No 

TANKER  RANGE 

RA 

TANKER  RANGE  RATE 

RA 

CENTERLINE  DISPL. 

Yes 

LIGHTS  UP 

Yes** 

DOWN 

Yes** 

FORE 

Yes** 

AFT 

Yes** 

ALTITUDE  ERROR 

RA 

CROSS  TRACK  ERROR 

No 

POSITION  ERROR 

Yes 

RANGE  FROM  LEAD 

RA 

BEARING  FROM  LEAD 

RA 

AALTITUDE  FROM  LEAD 

RA 

ACTUAL  AIR  RELEASE  PT. 

Yes 

RANGE 

RA 

RANGE  RATE 

, RA 

BEARING 

RA 

TGT.  SLANT  RANGE 

RA 

AIM  POINT  ERROR 

Yes 

BOMB  FALL  LINE 

Yes 

FLIGHT  PATH 

RA 

SPACING 

RA 

RANGE 

RA 

AZIMUTH  . 

RA 

ELEVATION 

Yes 

TGT.  RANGE 

RA 

TGT.  RANGE  RATE 

RA 

TGT.  ASPECT  ANGLE 

RA 

TGT.  HDG  CROSS  ANGLE 

No 

ELEVATION 

RA 

SPACE  PATH 

No 

*RA  = Reduced  Accuracy. 

* ♦Obtainable  with  Video/Photo  System, 
but  not  easily  otherwise. 


when  spatial  tracking  data  are  needed.  Of  course  the 
schedules  at  existing  ranges  are  often  filled,  and  it  may  be 

difficult  to  arrange  for  segments  of  training  to  occur  at  such 
ranges. 


, - — • It  is  clear  that  many  kinds  of  information  can 

°ktained  with  video/photo  recording  which  would  otherwise  be 
d^f  • rUlt  acc3u^re»  while  at  the  same  time  allowing  acquisition 
of  information  from  the  cockpit  panel  to  be  sampled  at  will  (if 
an  instrument  is  in  view  the  information  may  be  sampled  later  if 
desired).  Out-the-window  information  is  quite  important  to  combat- 
crew  training  measurement  in  all  phases,  except,  of  course,  during 
instrument  f lying . Through  video/photo  recording,  information  can 
® 9 cane  rom  the  view  of  the  runway,  the  radar  scope  picture, 
other  aircraft  through  the  windscreen,  the  path  over  the  drop  zone, 

^Ve4-Jel^t;L?nSuh;Lp  t°f  ground  targets  to  the  pipper,  and  the  position 
of  the  dart  throughout  firing.  These  are,  indeed,  important  in- 
formation. 


g1(?.ltal  recording.  The  primary  virtues  of  automatic  digital 
recording  are:  U)  high  speed  and  accuracy,  (2)  ability  to  sense 

information  which  cannot  be  directly  seen  with  a camera  in  the 
cockpit,  and  (3)  automated  computer  processing  with  data  in 
eie?t^on^c  format  compatible  with  computing  equipment.  Recording 
of  information  such  as  pilot  control  stick  movements  is  difficult 
to  acquire  without  direct  recording  of  control  stick  sensors, 
since  it  will  be  impossible  to  gain  a proper  camera  view  in  a 
fighter-type  aircraft.  Any  data  required  for  complex  calculations 
(as  simple  as  a mean  or  standard  deviation)  will  necessarily  be 
at  a relatively  high  sampling  rate  (i.e.,  often  enough  to  render 
manual  processing  impractical)  requiring  digital  recording  to 
permit  automatic  high-speed  processing.  While  video/photo  sensing 
has  an  advantage  for  acquisition  of  out-the-window  information, 
instrumentation  can  record  unseen  items  critical  to  measurement 
computations  (i.e.,  start-stop  parameters  such  as  weight-off- 
wheels)  , and  permit  complex  sophisticated  measurement  unlikely  to 
be  exceeded  by  future  research  demands. 


Comparison  of  Video/Photo  and  Digital  Recording  Techniques 


The  remaining  tradeoff  comparisons  are  between  the  two 
primary  methods  of  data  acquisiton:  measurement  systems  based  on 

video-photo  techniques  as  contrasted  with  systems  based  on  digital 
recording  techniques.  For  these  purposes,  to  achieve  a degree  of 
simplification,  two  candidate  systems  will  be  considered  based 
entirely  on  one  approach  or  the  other.  The  comparisons  will  be 
conducted  according  to  guidelines  of  previously  established 
system  criteria. 


provide  needed  information.  Neither  video /photo  nor  digital 
recording  technique3  can  generate  all  measurement  desired.  Video/ 
photo  techniques  provide  convenience  in  collecting  out-of-the- 
wmdow  information,  while  digital  recording  techniques  can 
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accurately  determine  specially  sensed  information  and  permit 
sophisticated  computation.  It  can  be  argued  that  for  many 
applications  the  out-of-the-window  information  is  most  relevant 
to  combat-crew  training,  and  could  be  least  dispensed  with; 
however,  the  relative  value  of  the  information  presented  by  these 
two  system  types  depends  clearly  on  specific  research  goals,  and 
cannot  be  resolved  for  even  a given  training  phase  without  de- 
tailing precise  information  objectives.  Neither  video/photo  nor 
digital  recording  techniques  are  universally  superior  as  sources 
of  performance  information. 

Useful  format.  One  approach  presents  a pictorial  pre- 
sentation of  events,  while  the  other  allows  a numerical  or 
graphical  form.  The  superiority  of  formats  depends  on  the  use  of 
the  information.  The  video /photo  format  presents  information  in 
much  the  same  way  as  the  information  is  presented  in  flight; 
this  should  permit  ease  of  interpretation  by  the  instructor  pilot 
and  student,  forming  a framework  to  improve  communication  between 
instructor  and  student,  or  between  either  of  these  and  the  re- 
search scientists.  In  previous  analyses  (e.g.,  air  combat)  it 
has  been  shown  that  the  instructor  may  be  required  to  participate 
in  the  measurement  process,  and  in  all  cases  it  will  be  necessary 
to  maintain  a hi  gh  level  of  communication  to  enhance  the  develop- 
ment of  new  measurement.  On  the  other  hand,  a quantitative 
presentation  of  information,  in  a much  different  form  than  that 
presented  in  the  cockpit,  promises  hope  for  greater  objectivity 
and  the  solution  of  problems  which  appear  vague  when  discussed  in 
terms  of  ordinary  flight  parameters.  Thus  the  specific  format 
desired  apparently  also  depends  on  specific  usage. 

Both  pictorial  and  numerical/graphical  formats  are  likely  to 
be  desired.  It  should  be  noted  that  quantitative  information  can 
often  be  derived  from  the  pictorial  format,  and  that  much  of  the 
cockpit  displays  may  be  recreated  from  digital  recording.  If  a 
manual  process  is  desirable  on  other  grounds  then  it  is  probably 
more  convenient  to  extract  desired  quantitative  data  from  video/ 
photo  display;  an  automated  process  would  create  an  environment 
for  re-creating  cockpit  displays,  but  additional  costly  equipment 
is  involved. 

Research  cycle  time.  Five  research  periods  which  are  of 
concern  in  estimating  the  time  needed  to  conduct  research  are 
illustrated  in  Figure  10.  Estimates  of  time  periods  for  both 
digital  recording  and  video/photo  recording  appear  in  the  table 
incorporated  in  the  figure.  The  digital  recording  instrumentation 
time  periods  are  based  on  information  collected  during  a survey 
of  flight  test  experience  (reported  in  Chapter  II,  Supporting 
Analyses) ; these  are  therefore  considered  typical  of  complex  high- 
accuracy  data  collection.  The  video/photo  time  periods  are  based 
on  U.  S.  Air  Force  video  recorder  tests  and  estimated  resulting 
from  analysis  in  the  current  study.  Neither  set  of  estimates  is 
considered  optimistic  as  probably  shorter  time  periods  could  be 
realized  as  a result  of  sustained  use;  in  any  case,  it  should  be 
understood  that  these  estimates  include  gross  approximations. 
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The  installation  and  checkout  time  for  a digital  recording 
system  is  extensive  because  of  engineering  to  determine  sensors, 
wiring,  black  box  changes,  signal  conditions,  and  labor  in 
performing  aircraft  modification.  Because  of  the  complexity  of  a 
large  recording  system  (i.e.,  90  channels)  a significant  amount 
of  flight  test  and  trouble-shooting  is  anticipated. 

Calibration  and  maintenance  is  also  expected  to  be  extensive 
with  a large-scale  recording  system.  If  the  system  should  be 
like  most  flight  test  instrumentation,  a crew  of  engineers  and 
technicians  may  work  most  of  the  day  to  ensure  that  a test  flight 
can  occur  each  day.  A video/photo  system  will  also  require  check- 
out, calibration,  trouble-shooting  and  repair,  but  it  is  believed 
that  a moderate  amount  of  time  and  labor  can  achieve  multiple  test 
flights  each  day. 

Digital  recording  will  require  some  form  of  conversion  and 
digital  processing  to  provide  visible  data;  video  recording  can 
be  played-back  readily,  but  photo  processing  may  require  as  much 
as  24  hours  for  a heavy  sustained  data  processing  load. 

After  quick— look  data  are  available  and  data  corrections  are 
made,  measurement  computation  is  almost  immediate  with  digital 
recording,  while  manual  video/photo  processing  is  expected  to 
average  1— *5  hours  for  a flight  (video  recording  for  about  30 
minutes) , and  twice  as  long  to  get  manually  verified  results  (two 
data  clerks  checking  each  other) . 

Data  collection  (T,)  is  a critical  period.  It  is  probable 
that  concerted  effort  will  be  required  to  process  measurement  in 
pace  with  a training  squadron  schedule  with  either  video/photo  or 
digital  recording  systems.  The  unreliability  and  complexity  of 
large-scale  digital  recording  may  require  much  manpower  to  ensure 
that  each  instrumented  aircraft  will  collect  data  for  one  flight 
each  day.  On  the  other  hand,  hours  of  video/photo  manual  proc- 
essing are  needed  for  each  data  collection  flight,  raising  the 
possibility  that  a backlog  of  unprocessed  data  may  accumulate. 

The  danger  with  digital  recording  is  that  training  may  progress 
without  data  collection,  or  that  the  data  collection  schedu  e 
will  slip;  while  manual  video/photo  data  may  overload  the  proc- 
essing system  so  that  data  collection  proceeds  without  measurement 
feedback  and  data  analysis  schedules  slip. 


If  it  is  assumed  that  either  approach  can  keep  pace  then  it 
may  be  seen  that  the  major  remaining  difference  is  the  time  for 
modification,  installation  and  checkout.  Estimated  research  time 
is  shown  in  Table  21. 

If  research  is  conducted  in  a new  aircraft  or  simulator  (i.e. , 
one  that  has  not  been  used  to  conduct  research  with  either  measure- 
ment system  technique) , digital  recording  and  video/photo  recording 
techniques  will  require  18  months  and  9 months,  respectively,  but 
research  time  becomes  about  6 months  with  either  technique  for 
repetitive  application  in  a fixed  environment. 
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Figure  11.  Comparison  of  Digital  Recording  and 
Video  Photo  Research  Schedules. 


If  a sequence  of  studies  is  to  be  conducted,  progress  will 
be  as  shown  in  Figure  11.  If  a new  installation  is  required  for 
each  research  study,  two  studies  can  be  conducted  with  video/photo 
recording  for  every  study  conducted  with  digital  recording, 
assuming  that  video/photo  data  reduction  provides  needed  measure- 
ment and  keeps  pace  with  the  flying  schedule.  When  research  is 
repetitively  conducted  in  the  same  environment,  the  two  types  of 
systems  will  eventually  perform  studies  at  the  same  rate,  although 
two  extra  studies  will  be  initially  accomplished  with  video/photo 
techniques . 

It  is  assumed  for  each  of  the  above  comparisons  that  each 
technique  produces  the  same  measurement  so  that  time  is  one  of 
the  major  remaining  tradeoff  factors;  however  digital  recording 
processing  is  capable  of  measurement  more  sophisticated  than 
video/photo  techniques,  allowing  the  future  pursuit  of  research 
objectives  which  may  require  more  complex  information  than 
normally  specified  for  combat-crew  training. 

Costs.  While  system  costs  are  difficult  to  accurately 
determine  without  detailed  definition  and  soliciting  of  competitive 
manufacturer  estimates,  rather  gross  estimates  appear  to  be 
satisfactory.  The  digital  recording  instrumentation  estimates 
collected  have  ranged  (approximately)  from  $200,000  to  $1,000,000 
per  system,  while  a video/photo  system  would  range  (approximately) 
from  $75,000  to  $125,000.  Consequently,  digital  recording  involves 
about  5-10  times  the  expense  of  video/photo  recording  acquistion; 
processing  requirements  are  about  the  same,  although  manual  proc- 
essing will  permit  a more  austere  approach  to  data  reduction. 

The  cost  factor  therefore  weighs  heavily  in  favor  of  the  video/ 
photo  approach. 

Data  distortion.  Data  distortion  and  losses  are  possible 
and  inevitable  with  either  system  technique. 

Digital  recording  techniques  clearly  permit  greater  accuracy 
and  protection  against  interference  with  modern  digital  coding 
techniques;  however,  equipment  complexity  and  associated  failures 
promise  that  some  channels  of  data  will  be  occasionally  lost. 

Much  will  depend  on  specific  sensors  needed  for  digital  recording; 
some  sensors,  and  some  signals  from  within  avionics  black  boxes, 
will  present  engineering  challenges  for  reliable  measurement 
without  distortion. 

Video/photo  recording  will  be  susceptible  to  sun  angle, 
electronic  interference,  vibration  and  maneuvering  g's.  Engi- 
neering challenges  are  presented  here  also,  but  it  is  believed 
that  solutions  will  generally  be  found.  It  is  expected  that  some 
sun  angles  may  wash-out  the  picture,  destroying  data  collection 
at  some  aircraft-sun  relationships.  Video  recording  resolution 
is  limited,  requiring  specific  contrast  ratios,  shades-of-gray, 
and  visual-angle  subtense  for  data  processing. 
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if  ieAf3  Preliminary  testing,  when  initial  difficulties  subside, 
• a digital  recording  system  can  achieve  suffi- 

cient reliability  (with  adequate  maintenance)  to  be  clearly 

anJTlosses?  vldeo/photo  techniques  with  respect  to  data  distortion 

.~^ibi3ity. witl1  training  devices.  Perhaps  the  most 

disadvantage  of  digital  recording  for  research  is  the 

£6q?lred  f°r  training  device  modification,  in- 
stallation  and  checkout.  The  effort  required  for  the  first 

type  ?f  aircraft  are,  for  the  most  part,  to 
be  repeated  each  time  an  installation  in  a new  type  of  aircraft 

«LfeSire^*  ?e?sors  must  be  installed,  black-box  modifications 
wir^g~type  determined,  signal  conditioning  devices 
mnrft??^*reC°rding  system  installed,  and  aircraft  wiring  and 
research*10"  perforined'  for  each  new  training  device  used  in 

. Video/photo  recording  provides  a system  which  may  be  in- 
stalied,  remove  and  reused  from  aircraft  to  aircraft.  Each  new 

m?St  be  engineered»  but  primarily  with  respect  to 
mechanical  features  and  electronic  interference. 

Of  course,  performance  measurement  may  be  desired  in  the 
°r  part-task  trainer,  as  well  as  in  the  aircraft. 

inQfaii^  may  be  see?  thab  video/photo  recording  is  more  easily 
installed  since  no  electrical  interface  is  required  (or  re- 

be°fo^rin9  °f  ! digitaf  simulator)  . In  special  cases  there  may 
®?me  argument  for  using  one  type  of  system  in  aircraft  and 
P V”  ?lmulab°rs,  but  it  is  believed  there  is  merit  in  using 
ne  system  for  all  applications  to  provide  a common  input  for 
aata  processing, 

. Iterative  measurement  development.  Iterative  measurement 
develop, ,t  requires  the  ability  to  change  measureme't  ^ a 

iant  b°faEf?^ini"aryK,neasureinent  tests.  The  research  team  will 

^fiby  to  change  to  new,  perhaps  much  different,  measure- 
ment forms  with  sufficient  ease  to  allow  train- and- error  compar- 

_PIlf  Ppf^bal  recording  will  permit  the  examination  of  any  measure- 
ment based  on  the  specific  parameters  recorded  through  appropriate 
computer  programs.  It  may  be  quite  difficult  to  obtain  anew 
™Ta®"re  whlch  requires  recording  another  parameter  (i.e.,  adding 
another  recording  channel,  or  adding  new  sensors).  9 

. . videc>/photo  recording  permits  new  measurement  though  new 

iS  SactiblA  i?4.PhS  manVaf  Processing  clerks  if  (1)  the9measure 

=»  S Shield  <2>  th*  baSio 

It  is  believed  that  both  techniques  have  advantages  for  iter- 

areaLre^Pre^ent  development » but  video/photo  recording  provides 
greater  ease  for  measurement  experimentation. 
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Minimum  training  interference*  Any  measurement  device 
interferes  to  some  degree  with  the  process  being  measured,  but 
any  amount  is  undesirable.  One  must  therefore  attempt  to 
minimize  the  extent  and  likelihood  of  interference  from  a 
training  measurement  system. 

Both  recording  approaches  are  likely  to  require  either 
student  or  instructor  to  start  and  stop  equipment,  and  possibly 
to  mark  special  events.  In  addition  to  these  disturbances,  the 
presence  of  the  video/photo  system  will  be  evident  in  the  cockpit, 
and  may  even  be  occasionally  visible  by  the  crew;  consequently, 
training  interference  is  more  likely  with  video/photo  recording. 

External  data  correlation.  It  may  be  necessary  for  data 
from  radar  ranges,  subjective  questionnaires,  manuals,  or  other 
experiments,  to  be  merged  with  video/photo  or  digital  data 
acquisition  output.  Merging  of  data  will  be  performed  in  the 
data  processing  computer,  or  manually  if  in  small  amounts,  so 
that  this  requirement  does  not  greatly  impact  on  the  decision 
between  approaches  to  data  acquisition * 

Space,  weight  and  power.  Space,  weight  and  power  are  highly 
equipment-specific,  but  it  is  believed  that  video/photo  recording 
will  present  lesser  demands  on  physical  requirements.  A recorder 
will  be  needed  with  either  approach,  but  more  electronic  equip- 
ment will  be  needed  for  digital  recording  (although  not  necessarily 
a significant  amount  with  projected  technology) . 

Effective  personnel/facility.  Any  personnel/facility  combi- 
nation will  require  powerful  tools  to  pursue  research  goals; 
however,  the  personnel/facility  considerations  do  not  materially 
affect  a tradeoff  between  video/photo  and  digital  recording, 
except  as  already  reflected  in  the  preceeding  discussion  of 
criteria.  Otherwise  it  should  be  noted  that  video/photo  proc- 
essing will  require  greater  numbers  of  manual  data  clerks,  while 
digital  recording  will  require  more  engineers  and  technicians. 


IV . RECOMMENDATIONS 


A clear  uncomplicated  choice  is  not  possible  between  video/ 
photo  and  digital  recording  approaches  to  measurement  system 
design,  but  if  such  a choice  must  be  made,  video/photo  recording 
will  be  chosen  for  cost,  information  provided,  flexibility  and 
ease  of  use. 

However,  a hybrid  system,  combining  the  advantages  of  both, 
is  preferable  to  either  type  of  recording  alone.  Due  primarily 
to  cost,  the  bulk  of  measurement  parameters  would  be  derived 
from  a video/photo  system,  and  the  remainder  with  a small  digital 
recording  capability.  It  would  be  desirable  for  the  major  com- 
ponents of  a hybrid  system  to  have  a stand-alone  capability  of 
modest  means  and  power  for  all  combat-crew  training  measurement 
when  used  together.  Auditory  data  recording  should  be  incor- 
porated together  with  the  option  for  merging  data  with  that  from 
ground- tracking  radar.  All  data  recording  must  include  provision 
for  synchronization  with  all  other  data  sources. 

A broad  implementation  plan  is  shown  in  Figure  12.  Existing 
sources  of  data  must  be  used  initially  with  existing  processing 
facilities.  A two-camera  video  recording  system  and  an  auxiliary 
camera  (motion  or  time-lapse)  together  with  a time-share  computer 
terminal  provides  the  simplest  and  least-expensive  first  facility. 
A dedicated  digital  computer  next  adds  power  and  prepares  the  way 
for  addition- of  digital  recording  capabilities  (conversion  equip- 
ment will  be  needed  for  digital  processing).  Such  a facility 
will  permit  processing  of  spatial  information  when  used  on  an 
instrumented  range.  Addition  of  a multiple-target  tracking  radar 
would  be  the  last  step  if  research  requirements  dictate  the  need 
for  a dedicated  radar. 
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STAGES 


x.  existing  sources  of  data 

IX.  DUAL  VIDEO  + PHOTO  + TIME-SHARE 

III.  DUAL  VIDEO  + PHOTO  + DATA  PROCESSOR 

IV.  DUAL  VIDEO  + PHOTO  + SMALL  DIGITAL  RECORDER  + 

CONVERSION  EQUIP. 


V.  DUAL  VIDEO  + PHOTO  + SMALL  DIGITAL  RECORDER  + 
CONVERSION  EQUIP.  + RADAR 


Figure  12.  implementation  Stages. 
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